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Introduction and Overview 



The importance of student 
satisfaction assessment 

Adult learners are a growing population 
on campuses across the country. An 
increasing number of institutions are 
adding adult focused programs to their 
offerings. Students are seeking course 
offerings which are flexible and fast 
paced to allow them to meet their educa- 
tional goals while still balancing work 
and family responsibilities. 

Serving the needs of adult learners in this 
environment becomes a greater priority 
for colleges and universities. Student 
satisfaction is considered a core element 
for higher education institutions serving 
traditional-age, on-campus students, 
and now more colleges and universities 
are expanding this assessment activity to 
adult learners as well. As this group 
becomes a larger segment of the overall 
student population, it is important to 
include adult learners in systematic 
assessment activities. 



Satisfaction assessment enables institutions to 
strategically and tactically target areas most in 
need of immediate improvement. It facilitates the 
development of planning and intervention priori- 
ties specific to adult learners, and it helps institu- 
tions examine student transactions with all major 
aspects of their experience, including academic, 
registration, and customer service. 

College and university leaders must understand 
how satisfied adult learners are with their educa- 
tional experience — both inside and outside of the 
classroom setting — in order to best serve those 
students. By collecting satisfaction data from 
adult learners on a regular basis, campuses are 
able to determine where they are best serving 
these students and where there are areas for 
improvement. 

Satisfied students are more likely to be successful 
students. Research indicates that institutions with 
more satisfied students have higher graduation 
rates, lower loan default rates, and higher alumni 
giving. Satisfaction with an institution includes a 
combination of academic factors as well as areas 
related to campus services. An institution needs to 
identify all of the issues that are relevant to 
students. These include their interaction with 
faculty, as well as the service they receive from 
staff and administrators; the resources provided to 
students; policies that are in place; and students’ 
overall feelings about the value of the experience. 

Satisfaction assessment can be further refined by 
capturing students’ level of importance (or 
expectation). Importance ratings provide institu- 
tions with valuable data on the areas that matter 
most to students. With this view, institutions can 
celebrate their strengths — those areas that have 
high satisfaction AND high importance. Institu- 
tions can also focus their improvement efforts on 
areas where satisfaction is low AND importance is 
high, and not be distracted by low satisfaction 
areas that may not matter to adult learners. 
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The importance of fit 

Campus leaders realize the importance of congru- 
ence or “fit” between what adult learners expect 
from their educational experience and their 
satisfaction with what they perceive as the reality 
of that experience. Research indicates that the 
greater the fit between expectations and reality, 
the greater the likelihood for persistence, student 
success, and stability. The opposite effect also 
applies: with greater incongruence or lack of fit 
comes higher attrition, poor performance, and 
fluctuation. 

Understanding this fit between what adult learners 
expect and what they experience is a primary 
benefit of satisfaction assessment. Importance 
indicators add another layer of understanding. The 
level of importance students place on a particular 
item indicates the level of expectation they assign 
to this area, and it also indicates the amount of 
value they associate with this item. Often an 
institution communicates value or the expectations 
that students should place on an area by the way 
they market or position themselves in a particular 
area. An institution can then better identify the 
fit between the student body and the institution 
when performance gaps are captured through the 
combination of satisfaction and importance data. 

A smaller performance gap indicates a better fit; 
a larger gap indicates more incongruence and an 
area of concern. 



In the complex environment of today’s higher 
education world, conducting satisfaction assess- 
ment is a way to ensure the vitality of the institu- 
tion. Regular satisfaction assessment and active 
response to the issues shows the institutional 
stakeholders good stewardship of scarce resources 
in an optimal way. This practice inspires trust 
among stakeholders, including adult learners, 
boards of trustees, and even state legislatures. 

It is also appropriate to note that satisfaction 
assessment should be a systematic process, not a 
one-time event. Shifts in satisfaction and expecta- 
tions that are tracked over time can identify where 
institutions are responding appropriately and what 
new issues are current priorities. Data that is 
timely and relevant will have the highest impact. 
Online learner characteristics and perceptions can 
change, and campus leaders will want to under- 
stand these changes in order to meet the transform- 
ing needs and circumstances of the student body. 



Research indicates 
that the greater 
the fit between 
expectations 
and reality, the 
greater the 
likelihood for 
persistence, 
student success, 
and stability. 



A note about reviewing the data 

While reviewing national results is vital for 
understanding the higher education marketplace, 
identification of individual institutional strengths 
and challenges is best done through data collected 
for those colleges. Campus leaders can identify 
their institution’s unique strengths and challenges 
from the perceptions of their own online learners. 



Responding is the key 

Conducting satisfaction assessment is a way to 
show adult learners that the institution cares about 
their perceptions and their educational experience, 
but an even more significant way that an institution 
can show that it cares is by actively responding 
to student-identified issues. Once data has been 
collected, actively reviewed, and shared through- 
out the campus, then initiatives can be identified 
to respond to adult learner concerns. Data on the 
shelf has no power; data actively used to drive 
decision making can have the power to improve 
the success of the institution. 



The study 

The 2005 National Adult Learners Satisfaction- 
Priorities Report presents the responses to the 
Adult Learner Inventory™ (ALI) of 20,466 
students from 45 institutions, including four-year 
private and public, and two-year community 
colleges. The results include adult learner 
responses over a three-year time period, from 
2002 through 2005. The ALI was developed by 
Noel-Levitz and CAEL (Council for Adult and 
Experiential Learning). CAEL is a non-profit 
organization dedicated to expanding lifelong 
learning opportunities for adults. (For further 
description of the survey tool and the list of 
participating institutions, please see the appendix.) 
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Importance-Satisfaction- 
Performance Gap 

On the ALI, students respond to statements of 
expectation with an importance rating and a 
satisfaction rating. These ratings are on a 1 to 7 
scale, with 7 being high. The student responses are 
averaged to produce an importance score and a 
satisfaction score for each item. A performance 
gap is calculated by subtracting the satisfaction 
score from the importance score. A larger perfor- 
mance gap indicates that the institution is not 
meeting student expectations; a smaller perfor- 
mance gap indicates that the institution is doing 
a relatively good job of meeting expectations. 
Negative performance gaps indicate the institution 
is exceeding student expectations; negative gaps 
are rare and are more likely to be found on items 
of low importance to students. 



Reviewing the 2005 data 

The 2005 National Adult Learners Satisfaction- 

Priorities Report includes the following data 

analyses: 

• The scales in order of importance. The 

scales represent the individual items on the 
survey which have been clustered together 
conceptually and statistically. The scales 
are presented for the overall adult learner 
responses. 

• Strengths and challenges. Strengths are 
identified as areas of high importance and 
high satisfaction. Challenges are defined as 
areas of high importance and low satisfaction 
and/or large performance gap. This section 
identifies adult learners’ key priorities for 
improvement as well as the top areas for 
celebration. 

• A review of enrollment factors in order of 
importance. This section helps institutions 
consider the top influencers in students’ 
decisions to enroll in an adult program. 

• A review of sources of information in order 
of importance. This section identifies the key 
sources of information for adult learners in 
their decision to enroll in an adult program. 



The scales 

For the Adult Learner Inventory, the 40 items of 
expectation are analyzed statistically and concep- 
tually to provide seven composite scales. These 
scales follow seven of the eight Principles of 
Effectiveness for Serving Adult Learners, as 
defined by CAEL. 

• Outreach assesses the way the institution 
conducts its outreach to adult learners by 
overcoming barriers of time, place, and 
tradition in order to create lifelong access to 
educational opportunities. 

• Life and Career Planning assesses how the 
institution addresses adult learners’ life and 
career goals before or at the onset of enroll- 
ment in order to assess and align its capacities 
to help learners reach their goals. 

• Financing assesses the way the institution 
promotes choice using an array of payment 
options for adult learners in order to expand 
equity and financial flexibility. 

• Assessment of Learning Outcomes looks at 
the way the institution defines and assesses the 
knowledge, skills, and competencies acquired 
by adult learners both from the curriculum and 
from life/work experience in order to assign 
credit and confer degrees with rigor. 

• Teaching-Learning Process assesses how the 
institution’s faculty use multiple methods of 
instruction (including experiential and 
problem-based methods) for adult learners in 
order to connect curricular concepts to useful 
knowledge and skills. 

• Student Support Systems addresses how the 
institution assists adult learners using compre- 
hensive academic and student support systems 
in order to enhance students’ capabilities to 
become self-directed, lifelong learners. 

• Technology assesses the institution’s use of 
information technology to provide relevant 
and timely information to enhance the 
learning experience. 

The eighth principle is Strategic Partnerships. This 
principle can be assessed through CAEL’s Institu- 
tional Self-Assessment Survey (ISAS). Strategic 
Partnerships looks at how the institution engages 
in strategic relationships, partnerships, and 
collaborations with employers and other organiza- 
tions in order to develop and improve educational 
opportunities for adult learners. 
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Analysis of the Scales 

The best place to begin is by looking at the big 
picture and understanding the areas on campus that 
matter most to adult learners. The following table 
summarizes the importance, satisfaction, and 
performance gap findings for the 7 scales on the 
Adult Learner Inventory. They are listed in order of 
importance. 



2005 Scales: Adult Learner Inventory 



Scale 


Importance 

Mean 


Satisfaction 

Mean 


Performance Gap 
Mean 


Outreach 


6.47 


5.68 


0.79 


Life and Career Planning 


6.31 


5.21 


1.10 


Teaching-Learning Process 


6.25 


5.66 


0.59 


Financing 


6.18 


5.34 


0.84 


Student Support Systems 


6.10 


5.33 


0.77 


Technology 


6.08 


5.37 


0.71 


Assessment of Learning Outcomes 


5.94 


5.21 


0.73 



(7 = very important /very satisfied 1 = not important /not satisfied at all) 



Analysis 

It is important that the analysis of the data include 
all three areas of measurement — importance, 
satisfaction, and performance gap. Focusing on 
only one area, such as performance gap, is likely to 
result in overlooking areas of the campus experi- 
ence that adult learners value most. A combination 
of scores provides the most dynamic information 
for institutions to consider when developing an 
action agenda. 

Using the matrix in Appendix II permits the 
institution to conceptualize its student satisfaction 
data by retention priorities (challenges) and 
marketing opportunities (strengths). In addition, it 
allows the institution to pinpoint areas where 
resources can be redirected from areas of low 
importance to areas of high importance. 



Strengths and Challenges 

The individual items on the Adult Learner Inven- 
tory can be analyzed to determine strengths (high 
importance and high satisfaction). These are the 
items that the institution can incorporate into their 
marketing activities, recruiting materials, and 
internal and external public relations opportunities; 
and can use to provide positive feedback to the 
faculty, staff, administration, and students on 
campus. Strengths are defined as being above the 
mid-point in importance and in the top quartile of 
satisfaction. 
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The items can also be analyzed to determine 
the key challenges (high importance and low 
satisfaction). These are the areas that the campus 
needs to address to improve retention at the 
institution. They are items where adult learners 
expect a lot, but where the institution is currently 
failing to meet their expectations. The areas of 
dissatisfaction are prioritized by their importance 
score so the institution knows it is working in the 
areas that matter most to adult learners. Challenges 
are defined as being above the mid-point in 
importance and in the bottom quartile of satisfac- 
tion and/or the top quartile of performance gaps. 

Following are the strengths and challenges as 
identified on the Adult Learner Inventory. They 
are listed in order of importance. 

Strengths (high importance/high 
satisfaction): 

• My program allows me to pace my studies to 
fit my life and work schedules. 

• I have a clear understanding of what I’m 
expected to learn in my courses. 

• My advisor is knowledgeable about require- 
ments for courses and programs of interest to 
me. 

• I am able to obtain information I need by 
phone, fax, e-mail, or online. 

• Processes and procedures for enrolling here 
are convenient. 

• I am able to choose course delivery that fits 
my life circumstances (e.g., on this campus, 
other campuses, online, in my community, at 
my workplace). 

• The learning experiences within my program 
of study challenge me to reach beyond what I 
know already. 



• My instructors respect student opinions and 
ideas that differ from their own. 

• The frequency of interactions with my 
instructors is adequate. 

• This institution provides “one-stop shop- 
ping” for most student support services 
(registration, financial aid, advising, text- 
book purchases, etc.). 

• Technology enables me to get the services I 
need when I need them. 

Challenges (high importance/low 
satisfaction): 

• My instructors provide timely feedback 
about my academic progress. 

• Sufficient course offerings within my 
program of study are available each term. 

• I receive the help I need to stay on track with 
my program of study. 

• I can receive credit for learning derived from 
my previous life and work experiences. 

• This institution provides students with the 
help they need to develop a plan of study 
before enrolling. 

• Information is available online to help me 
understand what I need to do next in my 
program of study. 
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Enrollment factors 



Sources of information 



Institutions should be aware of the factors which 
influence their adult learners’ decision to enroll 
in the program. Institutions often use this type of 
information to shape their recruitment activities. 
In this study, the enrollment factors indicated in 
descending order of importance for adult learners 
were as follows: 



Rank Item Importance 



1 


Convenient time and place for 
classes 


6.64 


2 


Flexible pacing for completing a 
program 


6.51 


3 


Ability to transfer credits 


6.47 


4 


Cost 


6.20 


5 


Reputation of institution 


6.19 


6 


Requirement for current or future job 6.15 


7 


Ability to design my own program 


6.09 


8 


Credit for learning gained from life 
and work experience 


6.01 


9 


Availability of financial assistance 


5.95 


10 


Distance from campus 


5.92 


11 


Availability of online courses 


5.87 


12 


Tuition reimbursement from employer 5.84 


13 


Program accreditation by 
professional organization or 
trade group 


5.44 


14 


Encouragement/incentive from 
supervisor 


4.55 


15 


Courses held at employment site 


3.82 


16 


Availability of child care 


3.60 


17 


Labor union support 


3.40 



Convenience was the primary motivating factor 
for enrollment in the program, followed closely by 
flexible pacing. Ability to transfer credits and costs 
also played a strong factor in enrollment decision 
making. 



Adult learners indicated the following sources 
of information in descending order of importance 
which influenced their enrollment in the program: 



Rank Item Importance 



1 


This institution's Web site 


5.98 


2 


Catalog (online) 


5.76 


3 


Catalog and brochures (printed) 


5.65 


4 


Contact with current students and/ 
or recent graduates of the program 


5.26 


5 


Recommendations from family and 
friends 


5.20 


6 


Recommendations from employer 


4.62 


7 


Program information session in my 
community 


4.53 


8 


Program information available at 
my workplace 


4.47 


9 


National college search Web site 


4.31 


10 


Personal phone calls from college 
representatives 


4.17 


11 


Newspaper 


3.95 


12 


Television 


3.90 



Not surprisingly, the primary source of information 
for adult programs was the Web site, followed by 
the online catalog. Newspaper and television 
advertisements were not important sources of 
information for most students. 
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A word about Noel-Levitz 

A trusted partner to higher education, Noel-Levitz 
helps systems and campuses reach and exceed 
their goals for enrollment, marketing, and student 
success. Over the past three decades, the higher 
education professionals at Noel-Levitz have 
consulted directly with over 1,700 colleges and 
universities nationwide in the areas of: 

• Student retention 

• Staff and advisor development 

• Student success 

• Marketing and recruitment 

• Financial aid services 

• Research and communications 

• Institutional effectiveness 

Noel-Levitz has developed an array of proven 
tools and software programs; diagnostic tools and 
instruments; video-based training programs; and 
customized consultations, workshops, and national 
conferences. With the Satisfaction-Priorities 
Surveys (including the Adult Learner Inventory), 
the firm brings together its many years of research 
and campus-based experience to enable you to get 
to the heart of your campus agenda. 

For more information, contact: 

Noel-Levitz 

2101 ACT Circle 
Iowa City, IA 52245-9581 
Phone: 800-876-1117 
Fax: 319-337-5274 
E-mail: info@noellevitz.com 



For more information on the Adult Learner 
Inventory, contact: 

Julie Bryant, Senior Director of Retention 

Solutions 

Noel-Levitz 

Phone: 1-800-876-1117 

Fax: 319-337-5274 

E-mail : julie-bry ant @ noellevitz .com 

www.noellevitz.com 

For more information on the Principles of 
Effectiveness for Serving Adult Learners, 
contact: 

Ruth Frey, Project Director 
CAEL 

55 East Monroe Street, Suite 1930 

Chicago, IL 60603 

Phone: 312-499-2668 

Fax: 312-499-2601 

E-mail: rfrey@cael.org 

www.cael.org 

The Adult Learner Inventory™ was developed by 
Noel-Levitz and CAEL in 2002 and is published 
by Noel-Levitz, Inc. 



For additional self-study options, CAEL 
has developed an Institutional Self- 
Assessment Survey that complements the 
Adult Learner Inventory. Contact CAEL 
for more information on this Survey and 
for information on becoming a partner 
in the Coalition of Adult Learning 
Focused Institutions. 
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Appendix I. Sample items 



Importance to me. . . 


Sample Adult Learner Inventory Items 


. . .My level of satisfaction 


1 = not important at all 


1 = not satisfied at all 


2 = not very important 




2 = not very satisfied 


3 = somewhat unimportant 




3 = somewhat dissatisfied 


4 = neutral 




4 = neutral 


5 = somewhat important 




5 = somewhat satisfied 


6 = important 




6 = satisfied 


7 = very important 




7 = very satisfied 



® 


® 








© 




My program allows me to pace my studies to fit my life and work schedules. ® 


® 


® 


® 


© 


© 


® 


® 


® 


® 






© 




Sufficient course offerings within my program of study are available each 
term. 


® 


® 


® 


® 


© 


© 


® 


® 


® 


® 


® 


® 


© 


® 


Billing for tuition and fees is tailored to meet my specific needs. 


® 


® 


® 


® 


© 


© 


® 


® 


® 


® 


® 


® 


© 


® 


I’m assessed on the knowledge and skills I’ll need in my life and career. 


® 


® 


® 


® 


© 


© 


® 


® 


® 


® 


® 


© 


© 


® 


My instructors provide timely feedback about my academic progress. 


® 


® 


® 


® 


© 


© 


® 


® 


® 


® 


® 


© 


© 


® 


This institution provides “one-stop shopping” for most student support 
services. 


® 


® 


® 


® 


© 


© 


® 


® 


® 


® 


® 


© 


© 


® 


Technology enables me to get the services I need when I need them. 


® 


® 


® 


® 


© 


© 


® 


® 


® 


® 


® 


© 


© 


® 


The frequency of interaction with my instructors is adequate. 


® 


® 


® 


® 


© 


© 


® 


® 


® 


® 


® 


© 


© 


® 


Processes and procedures for enrolling here are convenient. 


® 


® 


® 


® 


© 


© 


® 


® 


® 


® 


® 


© 


© 


® 


I can receive credit for learning derived from my previous life and work 


® 


® 


® 


® 


© 


© 


® 



experiences. 
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Appendix II. Matrix for prioritizing action 



Very 

Dissatisfied 



Matrix for Prioritizing Action 



♦ 



Very 

Important 



✓ 



Very 

Satisfied 



X 



Very 

Unimportant 



★ 



♦ High importance/low satisfaction 

pinpoints areas that should claim the 
institution’s immediate attention, i.e., 
retention agenda/priorities 

✓ High importance/high satisfaction 

showcases the institution’s areas of 
strength that should be highlighted in 
promotional materials 

X Low importance/low satisfaction 

presents an opportunity for the institution 
to examine those areas that have low 
status with students 

★ Low importance/high satisfaction 

suggests areas from which it might 
be beneficial to redirect institutional 
resources to areas of higher importance 
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Appendix III. Institutional participants 



Albright College, PA 

Baldwin- Wallace College, OH 

Big Sandy Community and Technical College, KY 

Biola University, CA 

Butler County Community College, PA 

California State University - Monterey, CA 

Capella University, MN 

Capital University, OH 

Central Michigan University, MI 

Chapman University, CA 

Community College of Allegheny County North, PA 

Community College of Beaver County, PA 

College of New Rochelle, NY 

College of Saint Scholastica, The, MN 

Concordia University Wisconsin, WI 

De Paul University, IL 

Doane College, NE 

Elizabethtown College, PA 

Elmhurst College, IL 

Fairleigh Dickinson University, NJ 

Governors State University, IL 

Grambling State University, LA 

Indiana-Purdue University Indianapolis, IN 

Inver Hills Community College, MN 

James Madison University, VA 

Lakeland Community College, OH 

Loyola University Chicago, IL 

Marylhurst University, OR 

Metropolitan State University, MN 

Millikin University, IL 

Montgomery College Rockville, MD 

National University, CA 

Potomac College, DC 

Regis University, CO 

Rider University, NJ 

Rio Salado College, AZ 

SUNY Empire State College, NY 

Southern State Community College, OH 

Union Institute, OH 

University of the Incarnate Word, TX 

University of Oklahoma Norman, OK 

University of Saint Francis, IL 

Westmoreland County Community College, PA 

Widener University, PA 

Youngstown State University, OH 
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Noel-Levitz 

Iowa City 
Denver 



Contact us at: 

2101 ACT Circle 
Iowa City, IA 52245 

800 - 876-1117 

319-337-4700 

E-mail: info@noellevitz.com 

Visit us on the Web: 

www.noellevitz.com 



About Noel-Levitz 

A trusted partner to higher 
education, Noel-Levitz helps 
systems and campuses reach 
and exceed their goals for 
enrollment, marketing, and 
student success. 

To help with goal attainment, 
our 30 full-time consultants 
and 50 associates bring direct 
experience from their previous 
and current positions on campuses 
as consultants, enrollment 
managers, marketing leaders, 
retention directors, institutional 
researchers, financial aid directors, 
faculty, student affairs leaders, 
advising directors, and more. 



